A Bio-Inspired Robust Adaptive Random Search 
Algorithm for Distributed Beamforming 



Chia-Shiang Tseng, Chang-Ching Chen, Che Lin 
Institute of Communication Engineering & Department of Electrical Engineering 
National Tsing Hua University, Hsinchu, Taiwan 30013 
E-mail: s9964518, s9864511, clin@ee.nthu.edu.tw 



O 

(N 

in 



> 

in 
d 

o 



X 



Abstract — A bio-inspired robust adaptive random search algo- 
rithm (BioRARSA), designed for distributed beamforming for 
sensor and relay networks, is proposed in this work. It has been 
shown via a systematic framework that BioRARSA converges 
in probability and its convergence time scales linearly with the 
number of distributed transmitters. More importantly, extensive 
simulation results demonstrate that the proposed BioRARSA 
outperforms existing adaptive distributed beamforming schemes 
by as large as 29.8% on average. This increase in performance 
results from the fact that BioRARSA can adaptively adjust 
its sampling stepsize via the "swim" behavior inspired by the 
bacterial foraging mechanism. Hence, the convergence time of 
BioRARSA is insensitive to the initial sampling stepsize of the 
algorithm, which makes it robust against the dynamic nature of 
distributed wireless networks. 

I. Introduction 

In recent years, the advancement of microelectronic technol- 
ogy makes possible the manufacture of low-cost transceivers 
that can be deployed with ease to form distributed sensor 
and relay networks. Since then, studies in distributed network 
have attracted enormous attentions. However, there are innate 
limitations, e.g., the lack of constant power supply for dis- 
tributed transmitters, that need to be particularly addressed 
in the applications of such networks. A viable solution to 
overcome this energy scarcity is for the distributed transmitters 
to form an antenna array and transmit collaboratively using 
distributed beamforming. The problem remains, however, as 
the beamforming coefficients for each distributed transmitters 
cannot be easily obtained without complete knowledge of 
the channel state information (CSI), which is in general not 
available at the transmitter end. 

A simple yet efficient adaptive distributed beamforming 
scheme that requires only a single bit feedback was proposed 
by Mudumbai et al in JTJ. The convergence analysis has 
been conducted using different approaches in the literature 
JTJ, J2), J3|, Q], where the fast convergence and the linear 
scalability of the scheme have been well established. With 
these extensive analyses, it has been shown that the simple 
one-bit adaptive scheme provides exceptional performance. 
The challenge ahead is then to discover new schemes that 
can further improve the performance without sacrificing much 
on the complexity. 

This work is supported by National Science Council, Taiwan (R.O.C.), 
under Grant NSC99-2221-E-007-089-MY3. 



In J21, we reformulated this adaptive distributed beam- 
forming scheme as a local random search algorithm under 
a systematic framework. Once reformulated in this random 
search framework, an immediately observation is that the per- 
formance can be improved by introducing Reverse Tracking 
a rather old technique in the field of random search algorithms 
0, (6|. Rigorous analysis has been carried out in (3| to 
show that the convergence rate can indeed be doubled once 
this intuitive idea is applied to the one-bit adaptive scheme. 
However, the exceptional performances of both the one-bit 
adaptive scheme and the improved reverse tracking scheme 
highly rely on proper tuning of system parameters with respect 
to the total number of transmitters, which may not be known a 
prior due to environmental variations or random node failures. 

Surprisingly, the key to achieve breakthrough sometimes 
lies in a completely different field. In [7|, a heuristic random 
search mechanism, that mimics the foraging behavior of E. 
Coli bacteria, was proposed. The randomized search strategy 
seems suitable for the phase alignment process of adaptive 
distributed beamforming, yet some features cannot be included 
due to the innate limitations of distributed networks. Therefore, 
we carefully redesign the bacterial foraging algorithm and pro- 
pose a bio-inspired robust adaptive random search algorithm 
(BioRARSA) that can adaptively adjust its sampling stepsize 
through the "swim" behavior of E. coli bacteria. As a result, 
BioRARSA is robust against all initial parameters and adapts 
well to the dynamic nature of distributed networks. 

We organize the paper as follows: In section[II] the problem 
of adaptive distributed beamforming in distributed wireless 
networks is described, and its connection to a random search 
framework is established. The description of our proposed 
scheme, BioRARSA, is presented in section [TTTJ Furthermore, 
the convergence analysis using the analytical tools proposed 
in (4) is provided in section IIVI In section [V] we show 
numerical simulations to demonstrate some interesting charac- 
teristics of BioRARSA. Finally, we conclude the advantages 
of BioRARSA and touch upon future works in section [VTJ 

II. Problem Formulation 

In this section, we introduce the problem of adaptive dis- 
tributed beamforming. To systematically analyze such prob- 

1 Reverse tracking is based on the intuition that if moving in the forward 
direction decreases the objective function, it is highly possible that moving 
in the reverse direction improves the objective function. 



lem, we further describe a recently proposed random search 
framework |4| that greatly facilitate the convergence analysis. 

A. Distributed Beamforming with Limited Feedback 

We begin with the formulation of the distributed beamform- 
ing problem. In our setting, N s distributed transmitters seek 
to transmit a common message s E C, with power constraint 



< P, to the remote receiver. Each transmitter and 



E [U 

the receiver is equipped with a single antenna, where the 
channel between each transmitter and the receiver is assumed 
to be frequency flat and slow fading. Also, each transmitter is 
allowed to alter its beamforming coefficient to achieve phase 
alignment. We assume that the distributed transmitters can 
only cooperate via a one-bit, error-free reverse feedback link 
from the receiver, since local cooperation requires sophisti- 
cated media access control (MAC) layer protocols, which may 
result in large energy dissipation and is not desirable for low- 
complexity distributed networks. 

Based on the system specification, the discrete-time, com- 
plex baseband model over one coherence interval is given by 
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is the channel fading gain, gi[n 



is the received signal, hi = ate^ 
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beamforming coefficients, and w[n) ~ CA^(0,<7 2 ) corresponds 
to the additive white Gaussian noise. 

To simplify notation^, we let s = \/~P and impose fixed 
power constraint b{ = 1 among transmitters. Assume that the 
magnitude of the signal component can be perfectly estimated, 
the received signal magnitude can be expressed as 



Mag(di [«],-•■ ,0jv>])=VP 
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where 0i[n] = fa + ipi[n] is the total phase of the received 
signal from transmitter i at the n-th transmission. 

In order to minimize detection error, it is clear we should 
maximize this magnitude function, and its global maxima are 
achieved when all phases are aligned, i.e., 0i[n] — 02 [n] = 
■ ■ ■ = 0N s [n]- In this setting, distributed transmitters seek to 
achieve this phase alignment adaptively with the help of a 
low rate feedback link. Consequently, we term such problem 
as adaptive distributed beamforming. 

B. A Random Search Framework 

With no prior knowledge of the channel fading coefficients, 
the received signal magnitude function is unknown for our sys- 
tem. However, for the n-th transmission, the remote receiver 
obtains a sample of Mag(-) at 0[n] = [0i[n] ■ ■■ 0n s [n]]. As 
a result, we can model the adaptive distributed beamforming 
problem as follows. 

2 The assumptions aim only for notation simplicity. As has been reported 
in (4), random search framework can be used to handle systems with more 
complicated power constraints, e.g., individual/total power constraints. 



Problem 1: Given an unknown function / : 9 — > K 
where only samples of /(•) is available, determine the global 
maximum value of /(•). 

For such problem, randomized schemes that utilize only 
samples of Mag(-) seems to be viable solutions. To analyze 
the convergence behavior of such randomized schemes for 
ProblemQ] we introduce the general random search framework 
proposed in (4). The framework describes a general random 
search algorithm, which we restate as follows: 

• Step 0: Initialize the algorithm by choosing an arbitrary 
initial point 0[O] € Q. 

• Step 1: Generate a random perturbation 8[n] according 
to a probability measure (i n , that could be time-varying. 

. Step 2: Update 0[n] by 0[n] = D(0[n-l],S[n]), where 
the mapping D(-, •) satisfies the condition that f(D(0[n— 
l],5))>/(0[n-l]). 

Clearly, the study of random search algorithms is a much 
more mature field in the mathematical society 0, 0. If 
the randomized scheme for adaptive distributed beamforming 
can be reformulated as the above random search algorithm, 
then the framework becomes a powerful tool that allows 
us to analyze the adaptive distributed beamforming schemes 
systematically. 

The analysis of the one-bit scheme proposed by Mudumbai 
et al is an immediate example of the application of such 
framework as has been shown in 0, where is equal to 
l Ws , and /(•) is the function Mag(-). The probability measure 
in this case is uniformly distributed in a hypercube centered 
at the origin with sides equal to 2A . The function D(-,-) is 
described by 

D(0[n- l],S[n]) = 

0[n - l]+S[n] ■ l{Mag(0[n-l]+5[n])>Mag(0[ri-l])} (3) 

where is the indicator function. As a result, the one-bit 
scheme can be reformulated as a simple local random search 
with fixed sampling stepsize. 

As has been shown in (TJ, 0, 0, the simple local random 
search algorithm performs surprisingly well. In this work, we 
hope to propose a new algorithm with even better performance, 
i.e, one that achieve phase alignment with less time or power, 
based on further understanding of the problem via the random 
search framework, and inspiration from the foraging behavior 
of E. coli bacteria in biology. 

III. Bio-inspired Robust Adaptive 
Random Search Algorithm - BioRARSA 

As indicated by its name, BioRARSA is inspired by the 
foraging behavior of E. coli bacteria. In Q, the foraging 
strategy and the life cycle of E. coli bacteria have been studied 
extensively. When foraging, a E. coli bacterium randomly 
chooses a direction and swims towards the chosen direction 
until the density of its food fails to improve. This randomized 
search strategy has been shown to be effective and applied 
in many fields. This motivates the inclusion of the "swim" 
behavior into our algorithm. By careful incorporation of the 



TABLE I 
Algorithm I - BioRARSA 



Initialize parameters 
repeat 

for i «— 1 to L.Helds do 
S[k] ~uni([-A fc ,A fe ]^) 
if Mag(0[fc - 1] + S[k]) < Mag(0[fc - 1]) then 

S[k] i S[k] 

end if 

if Mag(0[fc] + <5) > Mag(0[fc - 1]) then 
0[k]^0[k]+5 
fa*- I 

while Mag(0[fc] + 8[k}) > Mag(0[fc]) 
and < L.Swim do 
9[k] <- 9[k] +S[k] 

fa <- fa + 1 
end while 
end if 
k <- k + 1 
end for 

Avg.Swim <- max (a, Z^=fe-£.Heid+i A / L - H ^ ld s 
A k+1 «- A fe ■ Ai)g.5«iim 
until Stopping criteria reached 



foraging behavior into our algorithm, we propose BioRARSA 
that achieves superior performance and is highly robust against 
system uncertainty. 

A. Algorithm Description 

Now we introduce the proposed algorithm in details. The 
pseudocode of proposed algorithm is presented as Algorithm!!] 
in Table U and we elaborate the algorithm step-by-step as 
follows. 

Step 1 - Initialization: We first initializes the system by 
generating the initial phase 0[O] 6 R Wa . Other parameters 
of the system, including L.Held, L.Swim, and A , can be 
transmitted from the receiver to the transmitters or pre-coded 
into the system in this stage. The purpose of these parameters 
will become clear in the illustration of later steps. 

Step 2 - Random Perturbation: Assume now that the 
system is at the fc-th iteration. Each distributed transmitter in 
the system selects a random perturbation 5{ [k] that is uniformly 
distributed within [— Afc, A^], where is the sampling 
stepsize of the algorithm and can be adjusted iteratively. 
From the perspective of the entire system, a random vector 
5[k] = [6i[k] ■ ■ ■ Sjy^lk}] 7, that is uniformly distributed in 
[— Afc, Afc]^' is jointly generated by distributed transmitters. 

Once the random perturbations are generated, distributed 
transmitters add the perturbations to their beamforming coef- 
ficients and transmit the common message s simultaneously. 
Upon receiving the composite signal y[k], as in (Q]l, the 
receiver compares the received signal magnitude with the 
largest magnitude recorded up to the (k— l)-th iteration, and 
broadcasts a one-bit feedback signal to the transmitters. The 
broadcasted binary signal is given by 

S=l( ] (4) 

^Mag(S') > max Mag(0[i]O 



where 0' — 6[k — l]+6[k]. If "1" is broadcasted, i.e., received 
signal magnitude increased with perturbations, the algorithm 
enters Step 4. Otherwise, the algorithm enters Step 3. 

Step 3 - Reverse tracking: Each distributed transmitter 
multiplies its random perturbation 5i[k] generated in Step 2 
by —1, and use it to perturb the beamforming coefficients 
for the next transmission. After comparing the received signal 
magnitude with the previous ones, the receiver broadcasts a 
one-bit feedback signal back to transmitters as in Step 2. The 
broadcasted signal is the same as in except that now 6' = 
8[k — 1] — S[k]. If "1" is broadcasted, the algorithm enters 
Step 4. Otherwise, the algorithm enters Step 5. 

Step 4 - Swim: As the perturbations generated in Step 
2, or their reversed versions in Step 3 increase the received 
signal magnitude, the algorithm will proceed to search along 
the same direction by adding the same perturbations to the 
beamforming coefficients. Again, the received signal magni- 
tude achieved by these perturbed beamforming coefficients is 
compared with the previous ones as in Step 2 and Step 3. If 
"1" is broadcasted, transmitters update the beamforming coef- 
ficients with the perturbed value and return to the beginning of 
Step 4. Otherwise, the algorithm enters Step 5. Note that this 
step mimics the swimming behavior of E. coli bacteria, since 
the algorithm will continue to move along a direction once 
it is found to be beneficial and until no further improvement 
can be made. As a result, we term Step 4 as "swim" and the 
number of iterations spent in Step 4 as "swim length". 

In fact, Steps 2-4 can be combined into a single expression 
given by 

O[k] = O[k-l]+0 k -6[k] (5) 

where 

/3 k = argmax Mag(0[/c - 1] + N8[k]) (6) 

iV=0,±l,--- ,±L.Swim 

Notice that we impose a maximum swim length "L.Swim". 
This maximum swim length is set to prevent situations where 
the algorithm "swims" too far along a direction that only 
provides slight improvement on the performance. In this case, 
the expected improvement on the received signal magnitude 
through swimming is usually less than that achieved by gen- 
erating new perturbations. It has been verified via simulations 
that imposing such limit improves overall performances. 

Step 5 - Stepsize Adjustment: For every L.Held iterations, 
the algorithm adjusts its sampling stepsize A& according to the 
average swim length during the previous L.Held iterations. 
Also, the adjustment made to A& is no less than a factor a. In 
cases where the average swim length is close to zero, this a 
factor prevents the sampling stepsize A& from becoming too 
smalQ The stepsize adjustment can be described by 

A k = A fe _! • max (a, l&l / L.Helds) (7) 

\ i=k-L.Held+l / 

3 Setting sampling stepsize with values that are too small can sometimes 
cause random search algorithms to virtually "trap" in the local region, and 
severely degrade algorithms' performance. 



The overall effect can be seen as the algorithm adaptively 
increase the sampling stepsize if there were many "swims", 
which indicates that the perturbations generated were small 
on average, and decrease the sampling stepsize by a factor 
as small as a if there were only few or no "swims", which 
indicates that the search area is too large. 

For iterations that involve no adjustment, the value of 
remains unchanged as in the last iteration. No matter there is 
an adjustment or not, the algorithm returns to Step 2, which 
marks the end of the current iteration. 

Stopping criterion: During each step of BioRARSA, if 
the received signal magnitude is greater than a target valueQ, 
the algorithm exits and the phase alignment for transmit 
beamforming is said to be completed. 

B. Important Characteristic of BioRARSA 

As will become clear in section [V) the convergence behavior 
of BioRARSA is either insensitive to the choice of parameters 
at the initialization or to the number of distributed transmitters 
in the system. Therefore, all necessary parameters can be pre- 
coded and transmission overheads in Step 1 can be eliminated. 

Notice that although the algorithm is more complicated than 
the one-bit adaptive scheme, there is neither extra requirement 
on the feedback information nor the need for information 
exchange between distributed transmitters. The added cost is 
the computational complexity to execute the algorithm in the 
microprocessor equipped in each transmitter. However, energy 
consumed for such computation is negligible compared with 
that consumed by transmission. BioRARSA is hence a solid 
improvement over existing schemes. 

IV. Convergence Analysis 

The analysis of convergence can be greatly simplified via 
the use of the random search framework proposed in [4], which 
provides a general proof if the reformulated random search 
algorithm satisfies the following two conditions: 

1) The origin is an interior point of the support of the 
probability measure /i„ for all n. 

2) The objective function / : — > E is continuous and all 
of its local maxima are global maxima. 

These properties jointly provide the sufficient conditions for a 
local random search algorithm to converge. Therefore, in the 
ensuing discussions, we reformulate BioRARSA as a random 
search algorithm and examine these sufficient conditions. Once 
these conditions are satisfied, we can then apply the framework 
to show the convergence and linear scalability of BioRARSA. 

A. Reformulation and Sufficient Conditions 

Based on (0) and (O, the reformulation is as follows: 

/(•) = Mag(-) (8) 
p n = uni([-A„,A n ] Ws ) (9) 
Range {D(9, 6[n})} = {9 + fl} n U g (10) 

4 The target value can be based on statistics of the channel, which is assume 
to be available and known by receiver. 



where 

C/ 9 :={we9 Mag(u;) > Mag(0)} 
Q = {u>\u> = L.Swim ■ u>, u> G supp(/i„)} 

Unlike the original one-bit adaptive scheme, the support of 
S[n] is extended to since the "swim" step allows the 
perturbation to reach further by a factor of L.Swim. Although 
the probability distribution in £1 is no longer uniform, it is clear 
that the origin still lies in the interior of f2. Therefore, the first 
sufficient condition is satisfied. 

The property of Mag(-) has been identified by Lin et al J2| 
that all its local maxima are global maxima. This property is 
important since it ensures that a local random search algorithm 
can never be trapped in local maxima. Hence, the second 
sufficient condition is also satisfied. 

B. Proof of Convergence 

As both sufficient conditions are satisfied, we proceed to 
the proof of convergence with the help of the framework 
in |4|. Since the framework guarantees convergence of the 
target algorithm once both sufficient conditions are satisfied, 
the proofs parallel those derived in flU and are hence omitted 
here due to space constraint. The sufficient conditions lead to 
the following proposition. 

Proporsition 1: For any given 9 G Q\R e and A > 0, there 
exists 7 > and < rj < 1 such that 

Pr[/(0 + *)-/(0)>7]>»? 

where S is a random vector generated with the probability 
measure p n , R e is the e-convergence region as stated in 0, 
which is defined as R e := {6 G 6 : f(0) > f (0*) - e}, and 
0* is a global maximum point. 

Proposition \T\ states that there is always a non-zero prob- 
ability to improve the received signal magnitude within each 
iteration before the stopping criterion is satisfied. Based on 
this, the random search framework provides the following 
theorem 

Theorem 1: The sequence converges in proba- 

bility, i.e., given e > 0, 

lim Pr[0[n] G R e ] = 1 

n— >oo 

As the sequence converges to R e , the received signal 
magnitude becomes greater or equal to Mag(0*) — e. By setting 
e infinitely small, we prove the convergence of BioRARSA. 

C. Linear Scalability 

BioRARSA inherits the same desirable feature of linear 
scalability from its predecessor. This can also be proven by 
using the random search framework. 

Theorem 2: The average time of convergence scales lin- 
early with N s . That is, there exists k < oo, such that 

E [Mag(0[n])] > Mag(0*) - e, Vn > k ■ N s . 

The detailed proof is omitted due to space constraint, but a 
brief description is given here: From the proof in J2), it has 
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Fig. 1. Trajectories of received signal magnitude of a 800-node system. 



Fig. 3. Performance comparison of 800-node systems. 
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Fig. 2. Performance comparison of 400-node systems. 



Fig. 4. Linear scalability of BioRARSA. 



been shown that the reformulated random search algorithm 
scales linearly with N s . Also, notice that the total number of 
transmissions of BioRARSA is upper bounded by L.Swim 
times the total number of transmissions of the reformulated 
algorithm described by (f8T>-(fTob. Since the reformulated algo- 
rithm is linearly scalable by the random search framework J21, 
BioRARSA must also be linearly scalable. 

V. Simulation result 

Numerical results presented in this section are conducted 
using Monte Carlo simulations. Each point in Fig. |2]to|4]and 
values in Table HI] are averaged over 10 4 random instances 
that consist of 10 2 pre-generated channel realization {hi} each 
with 10 2 independent random perturbation sequences {^[nil- 
Through simulations, we show the performance advantage and 
the robustness of BioRARSA, and proofs derived in Sec. [IV] 
are also validated. 

The performance is measured by the average number of 
simultaneous transmissions from distributed transmitters to 



the receiver before reaching the stopping criterion. We set 
L.Helds and L.Swim to 5 for these values are optimal for 
most systems. Simulation results that justify these choices of 
L.Helds and L.Swim are omitted due to space constraint. 

To demonstrate the robustness of BioRARSA with respect 
to the initial choice of sampling stepsize Ao, we first present 
two sets of trajectories of received signal magnitude traversed 
by the randomized algorithms in Fig. Q] Each magnitude 
trajectory corresponds to a realization of the beamforming 
coefficients recorded during the phase alignment process using 
the stated schemes, and A of each set is set to be 3° and 
9°, respectively. These trajectories confirm that BioRARSA 
is insensitive to the initial choice of Ao, while the number 
of transmissions in the reverse tracking scheme and the one- 
bit adaptive scheme increase nearly 60% when Ao increase 
from 3° to 9°. Note that we have generated these trajecto- 
ries repeatedly for different realizations and obtained similar 
behaviors. For all realizations, all three algorithms converge 
without exception. This also validates our proof in Sec. IIVI 
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Fig. 5. Evolutions of sampling stepsizes in a 800-node system. 
TABLE II 

Performance Gain of BioRARSA with Respect to 
The Reverse Tracking Scheme ( in %) 
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Aside from its robust nature, the overall performance of 
BioRARSA is competitive compared with existing schemes. 
From Fig.[2]and[3] it can be identified that the one-bit adaptive 
scheme is completely outperformed by the reverse tracking 
scheme and BioRARSA, and there exists a small set of Ao 
where reverse tracking outperforms BioRARSA if the reverse 
tracking scheme happens to choose the stepsizes that are close 
to the optimal values. However, the optimal choice of Ao is 
closely related to the number of distributed transmitters in 
the system, which is often difficult to track in a distributed 
network. On the contrary, BioRARSA is capable of providing 
near optimal performance without any prior knowledge of the 
system, making it more suitable for distributed networks. 

To provide a more detailed performance comparison be- 
tween the reverse tracking scheme and BioRARSA, the nor- 
malized performance gain (N RT - NbioRARsa) /N RT -100% 
is presented in Table HU where Nut and NbioRARsa are 
the average number of transmissions with respect to each 
scheme. In this setting, positive gain indicates that BioRARSA 
outperforms the reverse tracking scheme, and vice versa. By 
comparing the overall performance, we can see that the insen- 
sitivity to the initial choice of parameters allows BioRARSA 
to achieve better performance on a wide range of initial 
sampling stepsize compared with the reverse tracking scheme. 
In certain cases, the performance gain of BioRARSA over 



reverse tracking is as large as 29.8% on average. 

In section [TV] it was proven that BioRARSA scales linearly 
with respect to the system size, and this characteristic is further 
validated with the simulation shown in Fig. [4] Each line in 
the figure corresponds to different stopping criteria where the 
algorithm is stopped when Mag(0[n]) > C s t op ■ Mag (<?*), 
and Mag(#*) is the maximum achievable received signal 
magnitude as defined in Sec. [IV] From this, it is clear that 
BioRARSA is indeed linearly scalable with target magnitude 
ranging from 60% to 90% of Mag(0*). 

In Fig. [5] the evolutions of sampling stepsize A„ are 
presented, where the simulation setup is the same as those 
in Fig. Q] We observe that the adjusted sampling stepsize 
first increases drastically and then decreases gradually as the 
beamforming coefficients approach their optimal values, which 
confirms with the concept of "optimal relative stepsiz^f' as 
proposed in 0. Although only two samples were presented, 
this phenomenon was observed on most recorded samples. 

VI. CONCLUSION 

In this work, we propose a bio-inspired distributed beam- 
forming scheme, BioRARSA, based on our understanding 
of an existing one-bit adaptive scheme via a random search 
framework, and further inspired by a heuristic algorithm that 
mimics the bacterial foraging behavior. 

Our numerical simulations have validated the proofs derived 
in Sec. IIVI and shown that BioRARSA is more robust and 
efficient than the one-bit adaptive scheme uniformly and the 
reverse tracking scheme on average. This improved perfor- 
mance is achieved via the "swim" behavior that adjusts the 
sampling stepsize adaptively, and hence allowing BioRARSA 
to be robust against system uncertainties. 

In the future, we are interested in further examination of the 
robustness of BioRARSA under more practical systems. We 
would also like to improve our framework further such that it 
can also provide analysis of the rate of convergence. 
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